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(54) Image processing method and apparatus 

(57) An original image is transformed into a multi- 
resolution space and is thereby decomposed into 
images, each of which is of one of a plurality of different 
frequency bands. Emphasis processing is carried out 
on an image of a predetermined frequency band, which 
is among the plurality of the different frequency bands, 
by setting the degrees of emphasis such that the degree 
of emphasis for a picture element of the image of the 
predetermined frequency band, which picture element 
has a picture element value larger than a predetermined 
threshold value, may be set to be lower than the 
degrees of emphasis for the other picture elements of 
the image of the predetermined frequency band. An 
inverse transform is then carried out on the image of the 
predetermined frequency band, which has been 
obtained from the emphasis processing, and the 
images of the other frequency bands. A processed 
image signal is thereby obtained. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 

This invention relates to an image processing 
method and apparatus for carrying out image process- 
ing, such as emphasis processing, on an image of a 
predetermined frequency band in an original image. 

Description of the Prior Art 

Techniques for obtaining an image signal, which 
represents an image, carrying out appropriate image 
processing on the image signal, and then reproducing a 
visible image by use of the processed image signal 
have heretofore been known in various fields. For exam- 
ple, in Japanese Unexamined Patent Publication No. 
55(1980)-163772, the applicant proposed a method for 
carrying out frequency emphasis processing, such as 
unsharp mask processing, on an image signal, such 
that a visible radiation image may be obtained, which 
has good image quality and can serve as an effective 
tool in, particularly, the efficient and accurate diagnosis 
of an illness. With the frequency processing, an 
unsharp mask signal is subtracted from an image signal 
representing an original image, the resulting difference 
value is multiplied by an emphasis coefficient, and the 
thus obtained product is added to the image signal. In 
this manner, predetermined frequency components in 
the image are emphasized. 

A different method for carrying out frequency 
processing on an image signal has also been proposed. 
With the proposed frequency processing method, an 
image is transformed into multi-resolution images by a 
Fourier transform, a wavelet transform, a sub-band 
transform, or the like, and the image signal representing 
the image is thereby decomposed into signals falling 
within a plurality of different frequency l^nds. Thereaf- 
ter, of the decomposed signals, a signal failing within a 
desired frequency band is subjected to predetermined 
image processing, such as emphasis. 

Further, recently, in the field of image processing, a 
novel technique for transforming an image into a multi- 
resolution space , which is referred to as the Laplacian 
pyramid technique, has been proposed in, for example, 
Japanese Unexamined Patent Publication No. 6(1994)- 
301766. With the proposed Laplacian pyramid tech- 
nique, mask processing is carried out on the original 
image by using a mask having characteristics such that 
it may be approximately represented by a Gaussian 
function. A sub-sampling operation is then carried out 
on the resulting image in order to thin out the number of 
the picture elements to one half along each of two- 
dimensional directions of the array of the picture ele- 
ments in the image, arxl an unsharp image having a 
size of one-fourth of the size of the original image is 
thereby otDtained. Thereafter, a picture element having 



a value of 0 is inserted into each of the points on the 
unsharp image, which were eliminated during the sam- 
pling operation, and the image size is thereby restored 
to the original size. Mask processing is then carried on 

5 the thus obtained image by using the aforesaid mask, 
and an unsharp image is thereby obtained. The thus 
obtained unsharp image is subtracted from the original 
image, and a detail image of a predetermined frequency 
band of the original image is thereby obtained. This 

w processing is iterated with respect to the obtained 
unsharp image, and N number of unsharp images hav- 
ing sizes of 1/2^"^ of the size of the original image are 
thereby formed. As described above, the sampling 
operation is carried out on the image, which has been 

75 obtained from the mask processing with the mask hav- 
ing characteristics such that it may be approximately 
represented by the Gaussian function. Therefore, 
though the Gaussian filter is used actually, the same 
processed image as that obtained when a Laplacian fil- 

20 ter is used is obtained. Also, in this manner, the images 
of low frequency bands, which have the sizes of 1/2^^^ of 
the size of the original image are successively obtained 
from the image of the original image size. Therefore, the 
group of the images obtained as a result of the process- 

25 ing is referred to as the Laplacian pyramid. 

The Laplacian pyramid technique is described in 
detail in, for example. "Fast Filter Transforms for Image 
Processing" by Burt PJ., Computer Graphics and Image 
Processing, Vol. 16, pp. 20-51, 1981; "Fast Computa- 

30 tion of the Difference of Low • Pass Transform" by 
Growley J.L. Stern R.M., IEEE Trans, on Pattern Analy- 
sis and Machine Intelligence. Vol. 6. No. 2, March 1984; 
"A Theory for Multiresolution Signal Decomposition; 
The Wavelet Representation" by Mallat S.G., IEEE 

35 Trans, on Pattern Analysis and Machine Intelligence. 
Vol. 11, No. 7, July 1989; "Image Compression by 
Gabor Expansion" by Ebrahimi T, Kunt M., Optical 
Engineering, Vol. 30, No. 7, pp. 873-880. July 1991 ; and 
"Multiscale Image Contrast Amplification" by Pieter 

40 Vuylsteke, Emile Schoeters, SPIE, Vol. 2167. Image 
Processing (1994). pp. 551-560. 

Japanese Unexamined Patent Publication No. 
6(1 994) -30 1766 mentioned above discloses a method, 
wherein emphasis processing is carried out on the 

45 images of all of the frequency bands in the Laplacian 
pyramid, which images have been obtained in the man- 
ner described above, and the image of each frequency 
band, which has been obtained from the emphasis 
processing, is then subjected to an inverse transform, 

50 and a processed image is thereby obtained. In the dis- 
closed method, the image emphasis is carried out on 
the image signal of each frequency band by using the 
formula shown below. 

55 y=-mx(-x/m)'^ (x<0) 

y=mx(-x/m)'^ (x^O) 

wherein x represents the picture element value of each 
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picture element in the image, y represents the picture 
element value of each picture element in the image 
obtained from the emphasis processing, and m repre- 
sents the range of values which the picture elements 
can take (for example. m=l,023 in cases where the 5 
range of values, which the picture elements can take, is 
10 bits). 

Specifically, as the value of p becomes smaller, the 
degree of emphasis becomes higher. As the value of p 
becomes larger, the degree of emphasis becomes 10 
lower. The image emphasis is carried out with such a 
degree of emphasis. Also, in the method disclosed in 
Japanese Unexamined Patent Publication No. 6(1994)- 
301766. the value of p in the formula shown above is 
selected from the range of 0 to 1 , the degree of empha- 15 
sis for the picture element value of every picture ele- 
ment in the image, which is to be subjected to the 
emphasis processing, is thereby set to be larger than 1 , 
and the emphasis processing is thus carried out. Spe- 
cifically, the emphasis processing is carried out regard- 20 
less of the picture element values of the image such that 
the degree of emphasis may be larger than 1 with 
respect to every picture element value. In the image 
obtained from such processing, the image has been 
emphasized in each frequency band. Therefore, an 25 
image is obtained such that unsharp mask processing 
might have been carried out substantially with masks 
having a plurality of sizes in the aforesaid unsharp mask 
processing. 

Of the images of the plurality of different frequency 30 
bands, which images have been obtained from the 
aforesaid multi-resolution transform, the image of a 
comparatively high frequency band represents compar- 
atively fine image portions, such as image edges, which 
are to be used. Therefore, the signal value, which corre- 35 
sponds to a certain picture element in the image of a 
comparatively high frequency band, represents the dif- 
ference in contrast with picture elements located at 
positions comparatively close to the certain picture ele- 
ment. On the other hand, an image of a comparatively 4o 
low frequency band represents a gentle change in the 
image information of the background in the original 
image. Therefore, the signal value, which corresponds 
to a certain picture element in the image of a compara- 
tively high frequency band, represents the difference in 45 
contrast with picture elements located at positions com- 
paratively remote from the certain picture element. 
Accordingly, the picture element values of the image of 
a comparatively low frequency band are larger than the 
picture element values of the image of a comparatively so 
high frequency band. 

For example, in an image, in which an image por- 
tion to be used, that has a comparatively high density, is 
embedded, in cases where the image regions surround- 
ing the image portion have a low density, the level of ss 
contrast of the image portion with the surrounding 
image regions is comparatively high, and therefore the 
image is easy to view. However, in cases where the 
image regions surrounding the image portion have a 
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comparatively high density, the level of contrast of the 
image portion with the surrounding image regions is 
comparatively low, and therefore the image is difficult to 
view. 

As for such an image, if the emphasis processing is 
carried out with the method disclosed in Japanese 
Unexamined Patent Publication No. 6(1 994) -30 1766. 
both the image portion to be used, which has the com- 
paratively low level of contrast with the surrounding 
image regions, and the surrounding image regions will 
be emphasized together. Therefore, even if the empha- 
sis processing is carried out, the image portion to be 
used cannot be rendered perceptible. 

SUMMARY OF THE INVENTION 

The primary object of the present invention is to 
provide an image processing method, wherein image 
processing is carried out such that an image portion, 
which has a comparatively low level of contrast with the 
surrounding image regions, may become more percep- 
tible. 

Another object of the present invention is to provide 
an apparatus for carrying out the image processing 
method. 

The present invention provides an image process- f 
ing method, comprising the steps of: ':^<m 

i) transforming an original image into a multi-resolu- r - '.t 
tion space, the original image being thereby --^-t-^ 
decomposed into images, each of which is of one of 

a plurality of different frequency bands, 

ii) carrying out emphasis processing on an image of . 
a predetermined frequency band, which is among 

the plurality of the different frequency bands, by set- _ 
ting the degrees of emphasis such that the degree - ^ ,v 

of emphasis for a picture element of the image of - - 

the predetermined frequency band, which picture 
element has a picture element value larger than a 
predetermined threshold value, may be set to be 
lower than the degrees of emphasis for the other 
picture elements of the image of the predetermined 
frequency band, and 

iii) carrying out an inverse transform of the image of 
the predetermined frequency band, which has been 
obtained from the emphasis processing, and the 
images of the other frequency bands, a processed 
image signal being obtained from the inverse trans- 
form. 

The present invention also provides an image 
processing apparatus, comprising: 

i) an image decomposing means for transforming 
an original image into a multi-resolution space, the 
original image being thereby decomposed into 
images, each of which is of one of a plurality of dif- 
ferent frequency bands, 

ii) an emphasis processing means for carrying out 
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The term "setting a degree of emphasis to be lower" 
as used herein means the weakening of the degree of 
emphasis and embraces the restriction of the image sig- 
nal values. 

A!so, the term "transforming an original image into a 
multi-resolution space" as used herein means decom- 
posing the image signal, which represents the original 
image, into image signals representing the images of a 
plurality of different frequency bands by using a prede- 
termined filter for the Laplacian pyramid technique, the 
wavelet transform, the sub-band transform, or the like. 

Of the images of the plurality of different frequency 
bands, which images have been obtained by transform- 
ing an original image into the multi-resolution space, the 
image of a comparatively high frequency band repre- 
sents comparatively fine image portions, which are to 
be used. Therefore, the signal value, which corresponds 
to a certain picture element in the image of a compara- 
tively high frequency band, represents the difference in 
contrast with picture elements located at positions com- 
paratively close to the certain picture element. On the 
other hand, an image of a comparatively low frequency 
band represents a gentle change in the image informa- 
tion of the background in the original image. Therefore, 
the signal value, which corresponds to a certain picture 
element in the image of a comparatively high frequency 
band, represents the difference in contrast with picture 
elements located at positions comparatively remote 
from the certain picture element. Accordingly, the pic- 
ture element values of the Image of a comparatively low 
frequency band are larger than the picture element val- 
ues of the image of a comparatively high frequency 
band. 

The image processing method and apparatus in 
accordance with the present invention are based on 
such findings. With the image processing method and 
apparatus in accordance with the present invention, the 
emphasis processing Is carried out on the image of the 
predetermined frequency band, which Is among the 
Images of the plurality of the different frequency bands 
having been obtained from the transform into the multi- 



resolution space and which is to be subjected to the 
emphasis processing, by setting the degrees of empha- 
sis such that the degree of emphasis for a picture ele- 
ment of the image of the predetermined frequency 
band, which picture element has a picture element 
value larger than a predetermined threshold value, may 
be lower than the degrees of emphasis for the other pic- 
ture elements of the image of the predetermined fre- 
quency band. Therefore, as for an image of a low 
frequency band, the picture elements of which take 
comparatively large picture element values, the degree 
of emphasis becomes low. As for an image of a high fre- 
quency band, the picture elements of which take com- 
paratively small picture element values, the degree of 
emphasis becomes high. Also, In cases where the den- 
sity of the Image regions surrounding the image portion 
to be used have a comparatively high density, and 
therefore the image portion is imperceptible, the 
degrees of emphasis for the image regions surrounding 
the image portion to be used are set to be low. and the 
image portion to be used is emphasized to a high 
extent. Therefore, the image portion to be used can be 
rendered more perceptible. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram showing an apparatus 
for carrying out an embodiment of the image 
processing method in accordance with the present 
invention, 

Figure 2 is a block diagram showing a multi-resolu- 
tion decomposing process means. 
Figure 3 is an explanatory view showing a low pass 
filter, 

Figure 4 Is an explanatory view showing detail 
images of a plurality of different frequency bands, 
which are obtained with a Laplacian pyramid tech- 
nique, 

Figure 5A is a graph showing a profile of an image 
signal representing an original Image, 
Figure 5B is a graph showing a profile of an image 
signal representing an Image of a comparatively 
high frequency band. 

Figure 5C is a graph showing a profile of an image 
signal representing an Image of a comparatively 
low frequency band, 

Figure 5D is a graph showing a profile of a proc- 
essed image signal, 

Figure 5E is a graph showing a profile of an image 
signal representing an image of a comparatively 
high frequency band, which has been obtained 
from emphasis processing, 
Figure 5F is a graph showing a profile of an image 
signal representing an image of a comparatively 
low frequency band, which has been obtained from 
emphasis processing, 

Rgure 6 Is a graph showing an example of a table 

representing a degree of emphasis. 

Figure 7 Is a block diagram showing a restoration 



emphasis processing on an image of a predeter- 
mined frequency band, which is among the plurality 
of the different frequency bands, by setting the 
degrees of emphasis such that the degree of 
emphasis for a picture element of the image of the 5 
predetermined frequency band, which picture ele- 
ment has a picture element value larger than a pre- 
determined threshold value, may be set to be lower 
than the degrees of emphasis for the other picture 
elements of the image of the predetermined fre- w 
quency band, and 

iii) an inverse transform means for carrying out an 
inverse transform of the image of the predeter- 
mined frequency band, which has been obtained 
from the emphasis processing, and the images of is 
the other frequency bands, and thereby obtaining a 
processed image signal. 
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processing means, and 

Figure 8 is a graph showing a different example of a 
table representing a degree of emphasis. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

The present invention will hereinbelow be 
described in further detail with reference to the accom- 
panying drawings. 

Figure 1 is a block diagram showing an apparatus 
for carrying out an embodiment of the image processing 
method in accordance with the present invention. As 
illustrated in Figure 1 , the apparatus for carrying out the 
embodiment of the image processing method in accord- 
ance with the present invention comprises an image 
input means 1 for feeding an image signal, which repre- 
sents an original image, into the apparatus, and a multi- 
resolution decomposing process means 2 for carrying 
out a multi-resolution decomposing process on the orig- 
inal image and thereby obtaining decomposed images 
of a plurality of different frequency bands. The appara- 
tus also comprises an emphasis processing means 3 
for carrying out emphasis processing, which will be 
described later, on an image of a predetermined fre- 
quency band, which is among the decomposed images 
of the plurality of the different frequency bands having 
been obtained from the muiti -resolution decomposing 
process means 2. The apparatus further comprises a 
restoration processing means 4 for restoring the image 
of the predetermined frequency band, which has been 
obtained from the emphasis processing carried out by 
the emphasis processing means 3, and the images of 
the other frequency bands into a processed image. The 
apparatus still further comprises an image output 
means 5 for reproducing the processed image, which 
has been restored by the restoration processing means 
4, as a visible image. The apparatus also comprises a 
table storing means 6 for storing the information repre- 
senting a table of the degree of emphasis for the 
emphasis processing, which is carried out by the 
emphasis processing means 3. 

How the embodiment of the image processing 
method in accordance with the present invention oper- 
ates will be described hereinbelow. Figure 2 is a block 
diagram showing how the processing is carried out by 
the mutti -resolution decomposing process means 2 
shown in Figure 1 . In this embodiment, by way of exam- 
ple, the Laplacian pyramid technique is utilized in order 
to decompose an image signal S, which represents the 
original image, into multi-resolution images. As illus- 
trated in Figure 2, the digital image signal 8, which rep- 
resents the original image, is fed into a first filtering 
means 10 of the multi-resolution decomposing process 
means 2. In the multi -resolution decomposing process 
means 2, the digital image signal S is fed into a first fil- 
tering means 10, which carries out a filtering process on 
the digital image signal S by using a low pass filter. By 
way of example, as illustrated in Figure 3, the low pass 



filter approximately corresponds to a two-dimensional 
Gaussian distribution on a 5x5 grid. As will be described 
later, the same types of low pass filters as that shown in 
Figure 3 are utilized for all of the multi-resolution 
5 images. 

Also, in the filtering means 10, the image signal S, 
which has been obtained from the filtering process car- 
ried out with the low pass filter, is subjected to a sam- 
pling process. The filtering means 10 samples the 

w signal components of the image signal S at every sec- 
ond row and every second column in the array of picture 
elements of the original image. An image signal repre- 
senting a low-resolution approximate image g-i is thus 
obtained from the filtering means 10. The low-resolution 

15 approximate image g-j has a size of one-fourth of the 
size of the original image. Thereafter, in a first interpo- 
lating operation means 1 1 , a single picture element hav- 
ing a value of 0 is inserted into each of the points on the 
low-resolution approximate image gi, which were elimi- 

20 nated during the sampling process. Specifically, a single 
picture element having a value of 0 is inserted between 
every set of two adjacent picture elements located 
along each row and each column in the array of picture 
elements of the low-resolution approximate image g-|. 

25 The low-resolution approximate image g^, into which 
the picture elements having a value of 0 have thus been 
inserted at intervals of a single picture element, is 
unsharp, and the change in the signal value of the low- 
resolution approximate image g^ is not smooth due to 

30 the picture elements having a value of 0, which have 
been inserted at intervals of a single picture element. 

Further, in the first interpolating operation means 
1 1 , the low- resolution approximate image g-i , into which 
the picture elements having a value of 0 have been 

35 inserted in the manner described above, is subjected to 
a filtering process with the low pass filter shown in Fig- 
ure 3. An image signal representing a low- resolution 
approximate image g-t' is thus obtained from the first 
interpolating operation means 11. The change in the 

40 signal value of the image signal representing a low-res- 
olution approximate image g^' is smoother than the 
change in the signal value of the aforesaid low-resolu- 
tion approximate image g^, into which the picture ele- 
ments having a value of 0 have been inserted. Also, the 

45 low-resolution approximate image g-i ' has the character- 
istics such that the image information of the frequency 
band higher than the middle frequency in the frequency 
band of the original image have been eliminated from 
the original image. This is because, as described above, 

50 the size of the low-resolution approximate image g^ has 
been reduced to one-fourth of the size of the original 
image, the picture elements having a value of 0 have 
been inserted at Intervals of a single picture element 
into the low-resolution approximate image g-i. and the 

55 filtering process has then been carried out on the low- 
resolution approximate image g^ by using the low pass 
filter shown in Figure 3. As a result, the image is 
obtained such that the image information of the fre- 
quency band higher than the middle frequency in the 



5 



BNSDOCID: <EP 0756247A1 _!_> 




EPO 



frequency band of the original image might have been 
blurred with the Gaussian function. 

Thereafter, in a first subtracter 12, the image signal 
representing the low-resolution approximate image gi' 
is subtracted from the image signal S representing the 
original image, and an image signal representing a 
detail image bo is thereby obtained. Specifically, the 
image signal components of the image signal repre- 
senting the low-resolution approximate image g-|* and 
the image signal S representing the original image, 
which image signal components represent correspond- 
ing picture elements in the two images, are subtracted 
from each other. As described above, the low-resolution 
approximate image g^' has the characteristics such that 
the image information of the frequency band higher than 
the middle frequency in the frequency band of the origi- 
nal image might have been blurred. Therefore, the detail 
image bo represents only the image information of the 
frequency band higher than the middle frequency in the 
frequency band of the original image. Specifically, as 
illustrated in Figure 4. the detail image bo represents the 
image information of the frequency band of N/2 to N, 
where N represents the Nyquist frequency of the origi- 
nal image. 

Thereafter, the image signal representing the low- 
resolution approximate image g^ is fed Into a second fil- 
tering means 10 and subjected to the filtering process 
using the low pass filter shown in Figure 3. Also, in the 
filtering means 10. the image signal representing the 
low-resolution approximate image g^, which has been 
obtained from the filtering process, is subjected to a 
sampling process. The filtering means 10 samples the 
signal components of the image signal, which repre- 
sents the low-resolution approximate image gi. at every 
second row and every second column in the array of 
picture elements of the low-resolution approximate 
image g-j. An image signal representing a low-resolution 
approximate image g2 is thus obtained from the filtering 
means 10. The low-resolution approximate image Q2 
has a size of one-fourth of the size of the low-resolution 
approximate image gi , i.e. a size of one-sixteenth of the 
size of the original image. Thereafter, in a second inter- 
polating operation means 11, a single picture element 
having a value of 0 is inserted into each of the points on 
the low-resolution approximate image g2, which were 
eliminated during the sampling process. Specifically, a 
single picture element having a value of 0 is inserted 
between every set of two adjacent picture elements 
located along each row and each column in the array of 
picture elements of the low-resolution approximate 
image g2. The low-resolution approximate image g2, 
into which the picture elements having a value of 0 have 
thus been inserted at intervals of a single picture ele- 
ment, is unsharp, and the change in the signal value of 
the low-resolution approximate image g2 is not smooth 
due to the picture elements having a value of 0, which 
have been inserted at intervals of a single picture ele- 
ment. 

Further, in the second interpolating operation 
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means 11. the low-resolution approximate image g2, 
into which the picture elements having a value of 0 have 
been inserted in the manner described above, is sub- 
jected to a filtering process with the low pass filter 

5 shown in Figure 3. An image signal representing a low- 
resolution approximate image g2* is thus obtained from 
the first interpolating operation means 11. The change 
in the signal value of the image signal representing a 
low-resolution approximate image g2' is smoother than 

w the change in the signal value of the aforesaid low-res- 
olution approximate image g2, into which the picture 
elements having a value of 0 have been inserted. Also, 
the low-resolution approximate image g2' has the char- 
acteristics such that the image information of the fre- 

15 quency components higher than the middle frequency 
in the frequency band of the low-resolution approximate 
image gi has been eliminated from the low-resolution 
approximate image g^ 

Thereafter, in a second subtracter 12, the image 

20 signal representing the low-resolution approximate 
image g2' is subtracted from the image signal represent- 
ing the low-resolution approximate image g^. and an 
image signal representing a detail image b-i is thereby 
obtained. Specifically, the image signal components of 

25 the image signal representing the low-resolution 
approximate image g2' and the image signal represent- 
ing the low-resolution approximate image g^ which 
image signal components represent corresponding pic- 
ture elements in the two images, are subtracted from 

30 each other. As described above, the low-resolution 
approximate image g2' has the characteristics such that 
the image information of the frequency band higher than 
the middle frequency in the frequency band of the low- 
resolution approximate image g-i might have been 

35 blurred. Therefore, the detail image bi represents only 
the image information of the frequency band higher than 
the middle frequency in the frequency band of the low- 
resolution approximate image g^ Specifically as illus- 
trated in Figure 4. the detail image b^ represents only 

40 the image information of the frequency band higher than 
the middle frequency in the frequency band of the low- 
resolution approximate image gi. i.e. the image infor- 
mation of the frequency band of N/4 to N/2, where N 
represents the Nyquist frequency of the original image. 

45 In this manner, the detail image is obtained by carrying 
out the filtering process with the low pass filter having 
the Gaussian distribution. However, since the image 
having been obtained from the filtering process is sub- 
tracted from the low-resolution approximate image, sub- 
so stantially the same results as those obtained when the 
filtering process is carried out with a Laplacian filter can 
be obtained. 

The processing described above is carried out suc- 
cessively for low-resolution approximate images gk, 
55 where k=1 to N, which have been respectively filtered 
and sampled with the corresponding filtering means 10. 
In this manner, as illustrated in Figure 4. n number of 
detail images b^, wherein k=1 to n. and a residual image 
gL of the low-resolution approximate image are 
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obtained. The levels of the resolution of the detail 
images successively become lower, starting with the 
resolution of the detail image bo- Specifically, the fre- 
quency bands of the detail images b^ successively 
become lower. The detail images b^ respectively repre- 5 
sent the frequency bands of to with respect 

to the Nyquist frequency N of the original image, and the 
sizes of the detail images b^ become 1/2^*^ times as 
large as the size of the original image. Specifically, the 
size of the detail image bo, which has the highest reso- 10 
lutton. is equal to the size of the original image, and the 
size of the detail image bi. which has a high resolution 
next to the resolution of the detail image bo. is one- 
fourth of the size of the original image. The sizes of the 
detail images thus successively become smaller, start- 15 
ing with the size equal to the size of the original image. 
Also, the detail images are substantially identical with 
the images obtained from the process using the Lapla- 
cian filter. Therefore, the multi-resolution transform in 
this embodiment is referred to as the Laplacian pyramid. 20 
The residual image gL may be regarded as being an 
approximate image having a very low resolution with 
respect to the original image. In extreme cases, the 
residual image g|_ is constituted of only a single piece of 
image information, which represents the mean value of 25 
the signal values of the original image. The information 
representing the detail images b^ and the residual 
'iT^aQ© 9l- which have thus been obtained, is stored in a 
memory (not shown). 

Thereafter, in the emphasis processing means 3. 30 
emphasis processing is carried out on the detail images 
bk. which have been obtained in the manner described 
above. How the emphasis processing is carried out will 
be described hereinbelow. 

For example, in an image having the signal value 35 
distribution shown in Figure 5A, when a portion A and a 
portion B are compared with each other, it will be found 
that the regions surrounding the portion A have a com- 
paratively low density, and that the regions surrounding 
the portion B have a comparatively high density. There- 40 
fore, the portion B in the image is less perceptible than 
the portion A. In such cases, if the density in the regions 
surrounding the portion 8 is rendered low. the portion B 
will become more perceptible. The image processing 
method and apparatus in accordance with the present 45 
invention are based on such findings. In the embodi- 
ment of the image processing method in accordance 
with the present invention, as for a detail image bk of a 
predetermined frequency band, which is among the 
detail images b^ having been obtained from the trans- so 
form into the multi-resolution space and which is to be 
subjected to the emphasis processing, each of the pic- 
ture element values of the detail image bk is compared 
with a predetermined threshold value a. In cases where 
the picture element value of a picture element is larger 55 
than the threshold value a. the degree of emphasis for 
the picture element is set to be low. In cases where the 
picture element value of a picture element is smaller 
than the threshold value a, the degree of emphasis for 



247 A1 




the picture element is set to be high. For example, when 
the original image having the signal value distribution 
shown in Figure 5A is transformed into the multi-resolu- 
tion space by using the Laplacian pyramid technique, a 
signal of a comparatively high frequency band is 
obtained, which has a signal value distribution shown in 
Figure 5B. Also, a signal of a comparatively low fre- 
quency band is obtained, which has a signal value dis- 
tribution shown in Figure 5C. When the signal of the 
comparatively low frequency band shown in Figure 5C 
is compared with the signal of the comparatively high 
frequency band shown in Figure 5B. it will be found that 
the signal of the comparatively low frequency band 
shown in Figure 5C has the characteristics such that, in 
the region corresponding to the portion B, the signal 
value may be larger than the signal values of the other 
regions. The degree of emphasis is determined by com- 
paring the signal values with the threshold value a. 

Figure 6 shows a table T1 , which is used in order to 
determine the degree of emphasis and is stored in the 
table storing means 6. As illustrated in Figure 6, with the 
table T1, when the signal value of the detail image bk is 
larger than the threshold value a. the signal is 
restricted. When the signal value of the detail image bk 
is smaller than the threshold value a. the signal is 
emphasized- In Figure 6, m represents the range of val- 
ues, which the picture elements can take. For example, 
m=1 ,023 in cases where the range of values, which the 
picture elements can take, is 10 bits. In such cases, the 
threshold value a is approximately equal to 256. In 
accordance with the table T1 , the emphasis processing 
is carri^ out on the image of the high frequency band 
shown in Figure 5B and the image of the low frequency 
band shown in Figure 5C. 

With the emphasis processing carried out in the 
manner described above, as illustrated in Figure 5F. as 
for the image of the low frequency band shown in Figure 
5C, the signal is restricted. Also, as illustrated in Figure 
5E, as for the image of the high frequency band shown 
in Figure 5B. the signal is emphasized. 

Thereafter, an inverse transform is carried out on 
the detail image bk of the predetermined frequency 
band, which image has been obtain^ from the empha- 
sis processing, and the detail images of the other fre- 
quency bands. The restoration processing means 4 
carries out the inverse transform processing in the man- 
ner described below. 

Figure 7 shows how the inverse transform of the 
detail images is carried out. Firstly the image signal 
representing the residual image g|_ is fed into a first 
interpolating operation means 14. In the first interpolat- 
ing operation means 14. picture elements are inserted 
between adjacent picture elements of the residual 
image gi_. and an image signal representing an Image 
gi_', which has a size four times as large as the size of 
the residual image gL, is thereby obtained. The image 
signal representing the image gL' having been obtained 
from the interpolating operation is then fed into a first 
adder 15. In the first adder 15, the image signal compo- 



7 



BNSDOCID: <EP 075624 7A1J_> 




EPO 



nents of the image signal representing the image gL* 
and the image signal representing a lowest resolution 
detail image bp.-t, which image signal components rep- 
resent corresponding picture elements in the two 
images, are added to each other An image signal rep- 
resenting an addition image (gu'+bn.i) is thereby 
obtained. The image signal representing the addition 
image (gu'+bn-i) 'S then fed into a second interpolating 
operation means 14. In the second interpolating opera- 
tion means 14, picture elements are inserted between 
adjacent picture elements of the addition image (gL'+bn- 
1). and an image signal representing an image bn-i', 
which has a size four times as large as the size of the 
addition image (gL'+bn-i), is thereby obtained. 

Thereafter, the image signal representing the 
image bp.-i* is fed into a second adder 15. In the second 
adder 1 5, the image signal components of the image 
signal representing the image bn-i' and the image signal 
representing a detail image bn-2 of a resolution higher 
by a single level than the resolution of the detail image 
bp.^. which image signal components represent corre- 
sponding picture elements in the two images, are added 
to each other. An image signal representing an addition 
image (bn.i'+bn.2) is thereby obtained. The image signal 
representing the addition image (bp-i'+bn-a) 's then fed 
into a third interpolating operation means 14. In the third 
interpolating operation means 14, picture elements are 
inserted between adjacent picture elements of the addi- 
tion image (bp-i'+bn-a). and an image signal represent- 
ing an image bn-2'. which has a size four times as large 
as the size of the detail image bn.2. is thereby obtained. 

The processing described above is iterated, and 
the same processing is carried out also for the empha- 
sized image bkp. Specifically in an adder 15, the image 
signal representing the emphasized image bkp and the 
image signal representing an image bk.i', which is of a 
resolution lower by a single level than the resolution of 
the emphasized image b^p and has been obtained from 
the processing described above, are added to each 
other. An image signal representing the addition image 
(bkp+bk-i') is thereby obtained. Thereafter, in an interpo- 
lating operation means 14. picture elements are 
inserted between adjacent picture elements of the addi- 
tion image (bkp+bk-i*), and an image signal representing 
an interpolation image bkp' is thereby obtained. The 
processing is successively carried out for the detail 
images of higher frequency bands. Finally, in an adder 
15, an image signal representing an interpolation image 
b-i* and an image signal representing the detail image bo 
having the highest resolution are added to each other, 
and a processed image signal S' is thereby obtained. As 
illustrated in Figure 5D, the processed image signal S' 
has the characteristics such that the signal values of the 
regions surrounding the portion B are smaller than 
those in the image signal representing the original 
image. 

The processed image signal S' having thus been 
obtained is fed irrto the image output means 5 and used 
in the reproduction of a visible image. The image output 
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means 5 may be constituted of a display means, such 
as a cathode ray tube (CRT) display means, a recording 
apparatus for recording an image on photographic film 
by a light beam scanning operation, or a device for stor- 

5 ing an image signal in an image file on an optical disk, a 
magnetic disk, or the like. 

In the manner described above, the detail images 
are obtained from the multi-resolution transform carried 
out with the Laplacian pyramid technique, and the 

10 degree of emphasis for the detail image of a desired fre- 
quency band, which is to be subjected to the emphasis 
processing, is set in accordance with each of the picture 
element values of the picture elements of the image of 
the desired frequency band. Specifically, in cases 

15 where the picture element value is larger than the 
threshold value a, the degree of emphasis is restricted. 
In cases where the picture element value is smaller than 
the threshold value a. the degree of emphasis is 
emphasized. Therefore, even if the density of the 

20 regions surrounding the portion, which is to be used, is 
comparatively high as in the image represented by the 
image signal shown in Figure 5A, the density of the 
regions surrounding the portion to be used can be ren- 
dered low. Therefore, the level of contrast of the portion, 

25 which is to be used, with respect to the surrounding 
regions can be kept high, and a processed image can 
be obtained which is more perceptible. 

In the embodiment described above, for example, in 
cases where the range of values, which the picture ele- 

30 ments can take, is 1 0 bits, the threshold value a may set 
to be approximately equal to 256. However, the thresh- 
old value a is not limited to this value and may be 
altered in accordance with the range of values, which 
the picture elements can take, the kind of the image, or 

35 the like. 

Also, in the embodiment described above, the table 
T1 shown in Figure 6 is utilized in order to determine the 
degree of emphasis. Alternatively, a table T2 shown in 
Figure 8 may be utilized. As illustrated in Figure 8, the 

40 table T2 has the characteristics such that the signal may 
be restricted in cases where the picture element value is 
larger than the threshold value a, and such that empha- 
sis and restriction may not be carried out in cases where 
the picture element value is smaller than a threshold 

45 value p. In cases where the table T2 is utilized, a por- 
tion, which has a very small picture element value and 
can be considered as being noise, is not emphasized. 
Therefore, a processed image, in which noise is imper- 
ceptible and which has good image quality, can be 

50 obtained. 

Further, in the embodiment described above, the 
transform of the original image into the multi-resolution 
images is carried out by utilizing the Laplacian pyramid 
technique. However, the image processing method in 

55 accordance with the present invention is not limited to 
the use of the Laplacian pyramid technique. For exam- 
ple, the transform of the original image into the multi- 
resolution images may be carried out by utilizing one of 
other techniques, such as a wavelet transform or a sub- 
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band transform. 

The wavelet transform has recently been developed 
as a frequency analysis method and has heretofore 
been applied to stereo pattern matching, signal com- 
pression, and the like. The wavelet transform is 
described in, for example, "Wavelets and Signal 
Processing," by Olivier Rioul and Martin Vetterii, IEEE 
SP Magazine, pp. 14-38, October 1991; and "Zero- 
Crossings of a Wavelet Transform," by Stephane Mallat, 
IEEE Transactions on Information Theory, Vol. 37, No. 
4. pp. 1019-1033. Juiy 1991. 

With the wavelet transform, a signal is transformed 
into frequency signals, each being of one of a plurality of 
different frequency bands, in accordance with the for- 
mula 



W (a. b) = J f (t) h (a. b) d t 



(1) 



wherein 
f(t): 

W(a,b): 



the signal having an arbitrary wave form, 
the wavelet transform of f(t), 



1 



a: 
b: 



h(a, b) = h (at-b) 
7a 



the degree of contraction of the function, 
the amount of movement in the horizontal 
axis direction. 



Specifically, the filtering process is carried out by chang- 
ing the period and the degree of contraction of the func- 
tion h and moving the original signal. In this manner, 
frequency signals adapted to desired frequencies rang- 
ing from a fine frequency to a coarse frequency can be 
prepared. 

The sub-band transform includes the technique for 
obtaining the images of two frequency bands by utilizing 
a single kind of filter as in the wavelet transform, and the 
technique for obtaining the images of a plurality of fre- 
quency bands with a single simultaneous operation by 
utilizing a plurality of kinds of filters. 

Also, after the images of plurality of different fre- 
quency bands are obtained from the wavelet transform 
or the sub-band transform, the emphasis processing 
may be carried out in the same manner as that 
described above for the Laplacian pyramid technique. In 
this manner, the emphasis processing can be carried 
out such that the image information of the desired fre- 
quency band may be emphasized, and such that the 
unnecessary components, such as noise components, 
contained in the desired frequency band may not be 
emphasized. Therefore, a processed image can be 
obtained, in which noise is imperceptible and which has 
good image quality and can serve as an effective tool in, 



particularly the efficient and accurate diagnosis of an ill- 
ness. 

Claims 

5 

1 . An image processing method, comprising the steps 
of: 

i) transforming an original image into a multi- 
10 resolution space, the original image being 

thereby decomposed into images, each of 
which is of one of a plurality of different fre- 
quency bands, 

li) carrying out emphasis processing on an 

15 image of a predetermined frequency band, 

which Is among the plurality of the different fre- 
quency bands, by setting the degrees of 
emphasis such that the degree of emphasis for 
a picture element of the image of the predeter- 

20 mined frequency band, which picture element 

has a picture element value larger than a pre- 
determined threshold value, may be set to be 
lower than the degrees of emphasis for the 
other picture elements of the image of the pre- 

25 determined frequency band, and 

iii) carrying out an inverse transform of the 
image of the predetermined frequency band, 
which has been obtained from said emphasis 
processing, and the images of the other fre- 

30 quency bands, a processed image signal being 

obtained from the inverse transform. 

2. A method as defined in Claim 1 wherein said trans- 
form of the original image into the multi-resolution 

35 space is carried out with a technique selected from 
the group consisting of a Laplacian pyramid tech- 
nique, a wavelet transform, and a sub-band trans- 
form. 

40 3. A method as defined in Claim 1 wherein the original 
image is a radiation image. 

4. An image processing apparatus, comprising: 

45 i) an image decomposing means for transform- 

ing an original image into a multi-resolution 
space, the original image being thereby 
decomposed into images, each of which is of 
one of a plurality of different frequency bands. 

50 ii) an emphasis processing means for carrying 

out emphasis processing on an image of a pre- 
determined frequency band, which is among 
the plurality of the different frequency bands, by 
setting the degrees of emphasis such that the 

55 degree of emphasis for a picture element of the 

image of the predetermined frequency band, 
which picture element has a picture element 
value larger than a predetermined threshold 
value, may be set to be lower than the degrees 
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of emphasis for the other picture elements of 
the image of the predetermined frequency 
band, and 

iii) an inverse transform means for carrying out 
an inverse transform of the image of the prede- 5 
termined frequency band, which has been 
obtained from said emphasis processing, and 
the images of the other frequency bands, and 
thereby obtaining a processed image signal. 

10 

5. An apparatus as defined in Claim 4 wherein said 
transform of the original image into the multi-resolu- 
tion space is carried out with a technique selected 
from the group consisting of a Laplacian pyramid 
technique, a wavelet transform, and a sub-band is 
transform. 

6. An apparatus as defined in Claim 4 wherein the 
original image is a radiation image. 

20 
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